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Abstract A\Ve  consider  the  distributed  detection  problem,  in  which  a  set  of  decision  makers 
(DMs)  receive  observations  of  the  environment  and  transmit  finite-valued  messages  to  other  DMs 
according  to  prespecified  communication  protocols.  A  designated  primary  DM  makes  the  final 
decision  on  one  out  of  two  alternative  hypotheses.  All  DMs  make  decisions,  in  order  to  maximize  a 
measure  of  organizational  performance.  Given  the  DMs  and  the  communication  resources,  the 
problem  is  to  find  an  architecture  for  the  organization  which  remains  optimal  for  a  variety  of 
operating  conditions  (if  it  exists).  We  show  that  even  for  very  small  organizations  this  problem  is 
quite  complex,  because  the  optimal  architecture  depends  on  variables  external  to  the  team  like  the 
prior  probabilities  of  the  hypotheses  and  the  misclassification  costs,  so  that  global  conslusions  on 
optimal  organizational  structures  cannot  be  drawn.  We  thus  also  consider  suboptimal  solutions  and 
obtain  bounds  on  their  performance.  ^ 
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1.  INTRODUCTION  AND  PROBLEM  DEFINITION 


Scientists  of  very  different  disciplines  have  joined  forces  in  order  to  attempt  to  model 
decision  making  by  humans  in  cooperative  organizations  (teams).  Systems  theorists  try  to  obtain 
normative /  prescriptive  models  which  demonstrate  how  decisions  should  be  made;  the  conclusions 
obtained  from  these  models  form  hypotheses  the  validity  of  which  should  be  investigated  in 
practice.  Cognitive  psychologists  gather  data  and  develop  empirical/descriptive  models  which  they 
believe  demonstrate  how  decisions  are  made;  but,  these  models  are  "data  dependent"  and  usually 
demonstrate  how  certain  decisions  were  made  by  certain  DMs  under  certain  conditions,  rather  than 
how  decisions  are  made.  Research  efforts  have  tried  to  combine  the  fruits  of  both  approaches  into 
normative! descriptive  models  which  will  be  more  realistic  and  accurate  (for  example,  [GS66], 
1 P85]  and  [K89]).  These  models  should  assist  in  improving  decision  making  by  demonstrating 
how  decisions  are  indeed  made. 

It  is  worthwhile  to  note  that  although  systems  engineers  and  cognitive  psychologists  tackle  the 
problem  from  diametrically  opposed  perspectives,  they  also  share  many  common  analytical  tools  in 
their  modeling.  For  example,  consider  the  Receiver  Operating  Characteristic  (ROC)  curve  which  is 
the  cornerstone  of  mathematical  binary  hypothesis  testing,  since  it  offers  a  complete  description  of 
the  DMs  [V68],  The  ROC  curve  may  look  like  an  artificial  mathematical  creation,  but  there  is 
evidence  from  psychologists  to  suggest  that  human  DMs  can  also  be  characterized  by  such  a  curve; 
see  the  pioneering  book  by  Green  and  Swets  [GS66].  In  fact,  human  ROC  curves  have  been 
constructed  experimentally  and  have  been  employed  in  decision  analysis.  We  thus  concentrate  in 
our  normative  models  realizing  that  they  constitute  an  incomplete,  yet  integral,  part  of  the  effort  of 
modeling  decision  making;  we  will  try  to  derive  conclusions  which  subsequently  can  be  tested  in 
practice  to  determine  whether  they  can  improve  actual  human  decisions. 

The  problem  of  distributed  decision  making  in  a  hypothesis  testing  environment  has  attracted 
considerable  interest  during  the  past  decade.  This  framework  was  selected  because  i;  combines  two 
desirable  attributes;  the  mathematical  problems  are  easy  to  describe  so  that  researchers  from  diverse 
disciplines  can  understand  the  models  and  their  conclusions;  also,  the  problems  have  trivial 
centralized  counterparts,  so  that  all  the  difficulties  arise  because  of  the  decentralization  of  the 
decision  making  process.  On  the  other  hand,  these  problems  are  also  known  to  become 
computationally  intractable  (NP-hard)  even  for  a  small  number  of  DMs  and  a  small  number  of 
communication  messages  [TA85].  Thus,  in  order  to  overcome  the  limitations  caused  by  the 
combinatorial  complexity,  it  would  be  desirable  to  combine  DMs  into  more  compact  and 
aggregated  decision  making  units  so  as  to  obtain  building  blocks  for  larger  organizations,  which 
hopefully  have  tractable  quantitative  descriptions. 
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We  examine  problems  of  small  organizations,  that  is  cooperative  organizations  which  consist 
of  two  or  three  DMs  and  perform  binary  hypothesis  testing,  because  we  want  to  keep  the 
combinatorial  complexity  under  control,  so  that  the  difficulties  arise  only  from  the  intrinsic 
complexity  of  the  distributed  problems.  We  present  different  architectures  for  these  organizations, 
analyze  them  in  a  quantitative  manner  and  compare  their  performance.  We  investigate  whether 
some  "common  sense"  and  "intuitively  appealing"  beliefs  are  indeed  always  true  in  this 
framework.  As  a  concrete  example,  consider  an  organization  consisting  of  two  DMs,  one  better 
than  the  other.  We  determine  whether,  as  has  been  suggested,  the  final  team  decision  should  be 
made  by  the  better  DM;  it  would  have  been  desirable  for  organizational  design  to  prove  that  this  is 
always  true,  independent  of  parameters  external  to  the  team,  such  as  the  number  and  nature  of 
communication  messages  available  and/or  the  prior  probabilities  of  the  hypotheses.  But,  we  show 
that  the  optimal  assignment  of  the  DM  responsible  for  the  final  decision  is  depended  on  these 
external  parameters,  and  that  the  better  DM  should  not  always  make  the  team  decision,  although  in 
many  (but  not  all)  situations  this  is  optimal. 

The  Bayesian  decentralized  detection  problem  was  first  considered  in  [TS81],  where  the 
optimality  of  constant  threshold  strategies  was  established;  this  was  formalized  and  generalized  in 
[T89a].  Several  generalizations  of  the  basic  detection  model  have  appeared  in  [ET82],  [S86], 
[CV86],  [CV88],  [HV88]  and  [TP89].  The  parallel  architecture  with  identical  sensors  has  been 
analyzed  in  [R87],  [RN87],  [HV88]  and  in  [T88],  where  the  asymptotic  results  were  established. 
The  Neyman-Pearson  formulation  of  similar  problems  is  considered  in  [S86a],  [HV86],  [R87], 
[TV87]  and  [VT88],  where  different  team  architectures  are  compared;  different  team  architectures, 
for  the  Bayesian  case,  are  also  compared  in  [E82],  [RN87a]  (numerically)  and  [PA88] 
(analytically).  An  excellent  and  thorough  overview  of  the  field  was  presented  in  [T89]. 

The  distributed  binary  hypothesis  testing  model  is  defined  as  follows.  There  are  two 
hypotheses  Ho  and  H\  with  known  prior  probabilities  P(Ho)  >  0  and  P(H i)  >  0  respectively,  and 
the  team  (organization)  consists  oiN>2  DMs.  Let  yn,  the  observation  of  the  nth  DM,  be  a  random 
variable  taking  values  in  a  set  Yn,  n  =  1, ....  N.  We  assume  that  the  y„'s  are  conditionally 
independent  given  either  hypothesis,  with  a  known  cond  -  distribution  P(yn  I  Hj)J  =  0, 1.  We 
also  assume  that  the  communication  protocols  are  given  a  nown  to  all  the  team  members.  Let 
Dn  be  a  positive  integer,  n  =  1, ...,  N.  Each  DM  n  evaluates  a  Devalued  message  un  e  { 1, ...,  Dn) 
as  a  function  of  its  own  observation  and  of  some  (possibly  none)  messages  from  other  DMs;  that  is 
un  =  yn(yn ,  un )  where  the  measurable  function  yn :  Yn  x  Un  is  the  decision  rule  of  DM  n.  The 
vector  un  ( u„  e  Un)  consists  of  the  messages  transmited  to  DM  n  and  the  scalar  decision  u„  is  the 
message  transmitted  to  a  single  DM,  according  to  the  communication  protocols.  The  decision  of  a 
designated  DM,  called  the  primary  DM,  is  the  final  team  decision  and  declares  one  of  the 
hypotheses  to  be  true.  The  objective  is  to  choose  the  decision  rules  yn  for  the  DMs  (n~  1, ...,  N), 
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which  minimize  the  probability  of  error  of  the  team  decision,  taking  into  account  different  costs  for 
hypothesis  misclassifications;  let  J(u ,  H)  be  the  cost  of  the  team  deciding  u  when  the  true 
hypothesis  is  H 1  2  and  define  the  decision  threshold  rj,  as  follows: 

=  P(H0)[AUHo)-J(0,H0)] 

*  pm  [A  o,//i)-y(i,//i)] 

We  begin  in  section  2  with  the  simplest  non-trivial  example  and  compare  the  performance  of 
the  two  possible  architectures  for  the  two  DM  case;  the  tandem  architecture  (Figure  1(a) )  and  the 
parallel  architecture  (Figure  1(b) ).  In  section  3,  we  analyze  the  team  consisting  of  two  DMs  in 
tandem  and  examine  the  effects  of  variables  external  to  the  team  on  the  optimal  team  configuration. 
In  section  4,  we  discuss  the  team  which  consists  of  two  DMs  in  parallel  and  pay  special  attention  to 
the  case  where  both  DMs  are  identical.  In  section  5,  we  compare  the  architectures  for  the  teams 
consisting  of  three  DMs.  Finally  in  section  6,  we  present  our  conclusions. 


y»  y\ 


(a).  Two  DMs  in  Tandem  (b).  Two  DMs  in  Parallel 


Figure  1.  Architectures  for  Teams  Consisting  of  Two  DMs 


2.  TANDEM  VERSUS  PARALLEL  ARCHITECTURE 

Consider  a  team  which  consists  of  two  DMs  and  performs  binary  hypothesis  testing.  There 
are  two  alternative  architectures  for  this  team.  In  the  tandem  architecture  (Figure  1(a) )  one  DM, 
called  the  consulting  DM,  makes  a  decision  based  on  its  observation  and  transmits  a  binary 
message  to  the  other  DM,  called  the  primary  DM.  Then,  the  primary  DM  makes  the  final  team 

1  Throughout  this  discussion  we  assume  that  the  cost  function  is  such  that  it  is  more  costly  for  the  team  to  err  than 

to  be  correct  (i.e.,/(0,  H\)  >  J(l,  Hq)  >7(0,  Ho)).  This  logical  assumption  is  made  in  order  to  express  the 

optimal  decision  rules  in  the  convenient  likelihood  ratio  form. 

2  As  mentioned  above,  in  our  analysis  we  very  often  employ  the  ROC  curve  and  its  properties;  for  the  reader’s 
convenience  a  summary  of  these  is  included  in  appendix  A. 
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decision  based  on  its  own  observation  and  the  message  from  the  consulting  DM.  In  the  parallel 
architecture  (Figure  1(b) )  each  DMs  makes  a  decision  and  transmits  a  binary  message  to  the  fusion 
center  which  makes  the  final  team  decision  so  as  to  minimize  the  expected  cost.  The  prior 
probabilities  and  the  costs  are  assumed  to  be  known  by  all  the  DMs  in  both  architectures.  In  the 
following  problem  the  best  architecture  is  to  be  determined: 

PROBLEM  1.  Consider  a  team  which  consists  of  two  DMs  and  performs  binary  hypothesis 
testing;  determine  which  of  the  two  possible  architectures  for  the  team,  the  tandem  architecture 
( Figure  1(a) )  or  the  parallel  architecture  (Figure  2(b) ),  is  the  dominant  architecture;  that  is,  the 
architecture  that  achieves  superior  performance  for  any  prior  probabilities  and  costs. 

It  is  known  that  the  tandem  architecture  is  better  than  the  parallel  architecture.  Several 
comparisons  have  appeared  in  the  literature  demonstrating  that  the  tandem  architecture  achieves 
superior  performance  than  the  parallel  architecture  [ET82],  [R87],  [VT88].  We  include  a  proof 
because  it  is  more  formal  and  because  we  are  going  to  employ  this  result  as  a  lemma  in  the  proof  of 
subsequent  results. 

LEMMA  1.  Consider  a  team  consisting  of  two  DMs.  Then,  the  tandem  architecture  achieves  at 
least  as  good  performance  as  the  parallel  architecture. 

Proof.  The  proof  is  simple  and  straightforward.  Consider  a  team  consisting  of  two  DMs  in 
parallel  and  denote  by  F*  ={ya,  %,  y,)  the  set  of  the  optimal  decision  rules  for  the  two  DMs  and 
for  the  fusion  center  respectively.  The  optimal  decision  of  each  DM  n  depends  exclusively  on  the 
observation  yn  of  the  DM,  for  n-a,b\  the  decision  of  the  fusion  center  depends  on  the  decisions 
ua  and  Ub  of  the  two  DMs. 

Now  consider  the  same  two  DMs  in  a  tandem  architecture;  without  loss  of  generality  assume 
that  DM  b  is  the  consulting  DM.  DM  b  can  employ  %  to  make  its  decision  based  on  its  own 
observation.  Moreover,  DM  a  can  employ  ya  and  make  a  preliminary  decision  based  on  its  own 
observation  and  then  also  employ  y,  to  make  the  team  decision  based  on  DM  b's  message  and  on 
its  own  preliminary  decision.  The  proposed  decision  rules  ya  and  %  for  the  tandem  architecture  are 
thus  defined  by: 


K(ya,  ub)  —  y{ya(ya),ub) 

(2) 

%{yb)  =  Yb(yb) 

(3) 

The  proposed  decision  rules,  though  not  optimal  in  general,  enable  the  tandem  team  to  always 
duplicate  the  optimal  performance  of  the  parallel  team.  This  implies  that  the  tandem  architecture  can 
achieve  at  least  as  good  performance  as  the  parallel.  Q.E.D. 
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Note  that  the  above  result  neither  depends  on  the  DMs  involved,  nor  on  which  of  the  two  DMs 
is  the  primary  DM  in  the  tandem  architecture,  nor  on  the  prior  probabilities  and  the  costs. 
Furthermore,  the  result  can  be  generalized  for  any  number  of  messages  which  can  be  transmitted 
within  a  team,  as  long  as  the  consulting  DM  in  the  tandem  configuration  is  allowed  to  transmit  to 
the  primary  DM  the  same  number  of  messages,  as  it  (the  consulting  DM)  is  allowed  to  transmit  to 
the  fusion  center  in  the  parallel  configuration. 

3.  TWO  DMs  IN  TANDEM 
3.1.  Configuration  Comparisons 

Since  the  tandem  architecture  is  superior  to  the  parallel  architecture  for  teams  of  two  DMs,  it  is 
worthwhile  to  analyze  it  further.  Given  two  DMs,  we  would  like  to  determine  the  optimal 
configuration  for  the  tandem  team  (i.e.,  determine  which  DM  should  be  made  the  primary  one).  If 
one  DM  is  better  than  the  other,  it  is  intuitively  appealing  that  the  better  DM  be  made  the  primary 
DM.  Given  two  DMs  one  would  expect  to  have  the  better  DM  make  the  team  decision,  independent 
of  the  prior  probabilities  and  the  cost  assignments.  If  this  was  the  case,  then  the  optimal  way  of 
organizing  two  DMs  would  not  change,  say,  as  the  prior  probabilities  of  the  underlying  hypotheses 
vary.  This  has  also  been  supported  with  explanations  on  data  compression  [E82]  and  with 
numerical  results  [R87].  But,  it  is  not  true  in  general;  we  show  that  the  optimal  configuration 
depends  on  the  prior  probabilities,  on  the  cost  assignments  and,  in  a  counterintuitive  manner,  on 
the  number  of  messages  which  the  consulting  DM  is  allowed  to  transmit  to  the  primary  DM.  The 
necessary ?  conditions  which  characterize  the  optimal  decision  rules  of  the  two  DMs  were  obtained 
in  [ET82]  and  are  presented  for  completeness  in  appendix  B. 

y~  y»  y\  y* 

vs. 

Figure  2.  Different  Configurations  for  the  Two  DM  Tandem  Team 

Suppose  that  one  of  the  DMs  is  better  than  the  other,  i.e.,  its  ROC  curve  is  higher  than  the 
ROC  curve  of  the  other  DM.  There  exist  two  candidate  configurations  for  the  team;  either  make  the 
better  DM  the  primary  DM,  or,  make  the  better  DM  the  consulting  DM  (Figure  2).  Recall  that  the 
primary  DM  makes  the  final  team  decision.  Consider  the  following  problem: 
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PROBLEM  2.  Consider  two  DMs,  one  better  than  the  other.  Determine  whether  the  optimal 
configuration  of  the  tandem  team  which  consists  of  these  two  DMs  is  independent  of  the  external 
parameters  of  the  problem  (details  of  cost  function,  prior  probabilities)  which  determine  the  value 
of  the  decision  threshold  rj;  that  is,  which  of  the  two  possible  configurations  (Figure  2)  yields  better 
performance  than  the  other  for  all  values  of  r\. 

The  problem  of  the  optimal  configuration  can  be  reduced  to  a  simpler  problem  in  which  the 
worse  DM  will  have  a  three  piecewise  linear  ROC  curve  and  the  better  DM  will  also  have  a 
piecewise  linear  ROC  curve  with  at  most  four  line  segments1.  The  analysis  of  this  restricted 
problem  is  presented  in  appendix  C  and  yields  the  following  Example  1 .  The  ROC  curves  are 
presented  in  Figure  3  and  the  associated  discrete  probability  density  functions  for  the  two  DMs 
conditioned  on  the  two  hypotheses  are  presented  in  Figure  4,  The  team  ROC  curves  are  presented 
in  Figure  5  for  both  configurations.  It  is  interesting  to  note  that  for  J}  =  1.0,  performance  is 
maximized  by  making  DM  B  the  consulting  DM,  while  for  rj  =  0.4,  performance  is  maximized  by 
making  DM  B  the  primary  DM  (Table  1).  Thus,  in  this  example,  the  optimal  team  architecture 
depends  on  the  value  r\  (i.e.,  the  numerical  values  of  the  prior  probabilities  and  the  costs)  2 


1  This  fact  was  formalized  and  generalized  in  fT89a]. 

2  From  the  above  discussion  and  the  one  following  in  section  3.2,  one  may  conclude  that  the  counterintuitive 
findings  arc  a  result  of  discrete  distributions.  They  are  not,  because  we  can  construct  continuous  distributions  which 
have  piecewise  linear  ROC  curves  (for  example,  a  scries  of  uniform  distributions).  Moreover,  strictly  concave  ROC 
curves  will  not  affect  the  results,  since  strictly  concave  curves  which  approximate  the  piecewise  linear  ROC  curves 
within  e  can  be  constructed. 
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P(y*|Hi) 

y>  = 

P(yk|H0) 

y*  = 


(a).  Beuer  DM  (b).  Worse  DM 

Figure  4.  The  Probability  Distributions  for  the  DMs  of  Figure  3 


0.0  0.2  0.4  0.6  0.8  1.0 

Pf 


Figure  5(a).  The  Team  ROC  Curves  for  Both  Configurations  and  Binary  Messages 
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Figure  5(b).  Close  Up  on  Figure  5(a) 


TABLE  1.  Configuration  Comparison  for  Binary  Messages 


(i).  77  =  0.4  [P(Hq)  =  0.2857] 

m-fwT* 

[ZHZh 

Operating  Point  of  the  Consulting  DM: 

(0.5,  0.91) 

(0.5,  0.9) 

Operating  Point  of  the  Primary  DM  when  uc  = 

0: 

(0.1,  0.5) 

(0.1,  0.51) 

Operating  Point  of  the  Primary  DM  when  uc  = 

1: 

(0.5,  0.9) 

(0.5,  0.91) 

Operating  Point  of  the  Team: 

(0.3,  0.864) 

(0.3,  0.87) 

Probability  of  Error: 

0.1829 

0.1786* 

(ii).  77  =  1.0  [P(H0)  =  0.5] 

[THw> 

EHj> 

Operating  Point  of  the  Consulting  DM: 

(0.2,  0.7) 

(0.1,  0.5) 

Operating  Point  of  the  Primary  DM  when  uc  = 

0: 

(0.1,  0.5) 

(0.2,  0.7) 

Operating  Point  of  the  Primary  DM  when  uc  = 

1: 

(0.5,  0.9) 

(0.5,  0.91) 

Operating  of  the  Team  Point: 

(0.18,  0.78) 

(0.23,  0.805) 

Probability  of  Error: 

0.20* 

0.2125 

/ 


t 


*  Optimal 
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3.2.  The  Number  of  Messages 

Consider  again  the  example  of  the  previous  section  and  suppose  that  the  number  of  messages 
that  the  consulting  DM  can  transmit  to  the  primary  DM  is  increased  to  three.  Then,  if  the  worse  DM 
is  made  the  consulting  DM,  the  team  achieves  the  optimal  centralized  performance  because  the 
consulting  DM  can  transmit  its  observation  to  the  primary  DM.  The  same  result  can  not  be 
achieved  when  the  better  DM  is  made  the  consulting  DM.  Hence,  the  ROC  curve  of  the  team  with 
the  worse  DM  as  the  consulting  DM  is  higher  than  the  one  of  the  team  with  the  better  DM  as  the 
consulting  DM  (Figure  6);  thus,  for  the  case  of  three  messages  making  the  better  DM  the  primary  is 
optimal  even  for  77  =  1.0  (Table  2).  Therefore,  as  can  be  seen  from  Tables  1  (ii)  and  2,  the  optimal 
team  architecture  depends  also  on  the  number  of  messages. 

The  fact  that  the  optimal  team  architecture  depends  on  the  number  of  messages  is  not 
surprising,  but  the  way  it  does  is  counterintuitive.  Intuition  suggests  that,  as  the  number  of 
messages  increases,  it  becomes  more  likely  for  the  better  DM  to  be  placed  as  the  consulting  DM  in 
the  optimal  configuration,  because,  as  the  number  of  messages  increases,  the  loss  of  information 
caused  by  the  fusion  of  the  observation  of  the  consulting  DM  to  a  message  decreases.  This  is 
especially  obvious  in  the  two  limit  cases;  in  the  zero  message  (isolation)  case,  the  better  DM  should 
be  the  primary  DM,  thus  making  the  team  decision,  and,  in  the  infinite  message  (centralized)  case, 
the  better  DM  could  be  made  the  consulting  DM  without  causing  any  deterioration  in  the  team 
performance.  In  our  particular  example,  though,  assuming  77  =  1.0,  increasing  the  number  of 
messages  from  two  to  three  makes  the  better  DM  change  its  role  in  the  optimal  team  architecture 
from  being  the  consulting  DM  to  being  the  primary  DM;  a  counterintuitive  result. 


TABLE  2.  Configuration  Comparison  for  Ternary  Messages 


77  =  1.0  [P(Hq)  =  0.5] 

Operating  Point  (0  vs.  1)  of  the  Consulting  DM; 
Operating  Point  (1  vs.  2)  of  the  Consulting  DM: 
Operating  Point  of  the  Primary  DM  when  uc  =  0 
Operating  Point  of  the  Primary  DM  when  uc  =  1 
Operating  Point  of  the  Primary  DM  when  uc=  2 
Operating  Point  of  the  Team  : 

Probability  of  Error: 


B  — *  W  — ► 

|w  H  b  h 

(0.5,  0.91) 

(0.5,  0.9) 

(0.2,  0.7) 

(0.1,  0.5) 

(0.0,  0.0) 

(0.1,  0.51) 

(0.1,  0.5) 

(0.2,  0.7) 

(0.5,  0.9) 

(0.5,  0.91) 

(0.13,  0.735) 

(0.18,  0.786) 

0.1975 

0.197* 

*  Optimal 
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Figure  6(a).  The  Team  ROC  Curves  for  Both  Configurations  and  Ternary  Messages 


3.3.  Performance  Bounds 

The  main  objective  of  this  research  is  to  obtain  building  blocks  and  design  guidelines  for  large 
organizations.  In  section  3.1,  it  was  shown  that  the  intuitively  appealing  suggestion  of  designating 
the  bener  DM  as  the  primary  DM  is  not  optimal  in  general.  Still,  it  is  optimal  for  several  probability 
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density  functions  (as  will  be  seen  in  section  3.4  below)  and  even  in  cases  where  it  is  not  true  (like 
the  example  presented  above)  both  configurations  have  very  similar  performance.  Therefore,  it  is 
logical  to  designate  the  better  DM  to  be  the  primary  DM  and  try  to  obtain  a  bound  on  the 
deterioration  of  the  team  performance.  A  meaningful  bound  is  the  deterioration  of  the  team 
performance  relatively  to  the  optimal  team  performance. 

But  consider  the  following  Example  2,  for  which  the  optimal  team  configuration  requires  that 
the  better  DM  be  the  primary  DM.  The  ROC  curves  for  the  two  DMs  are  presented  in  Figure  7  and 
the  associated  discrete  probability  density  functions  conditioned  on  the  two  hypotheses  are 
presented  in  Figure  8.  Suppose  that  rj  =  1.0  (i.e.,  equal  prior  probabilities  and  minimum  error  cost 
function).  The  performance  of  the  team  is  measured  by  the  probability  of  error  as  usual. 


Figure  7.  The  DMs  in  Example  2 


Consider  any  m  such  that: 

m  >  1  (4) 

and  any  £  such  that: 

mm{l/2,  1/m)  >  £  >0  (5) 

Suppose  that  the  better  DM  is  the  consulting  DM.  The  optimal  operating  points  can  be  found 
on  Table  3  and  the  optimal  probability  of  error  is: 


(6) 
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1-c 


y w =  o  1  2 


(a).  Better  DM  (b).  Worse  DM 

Figure  8.  The  Probability  Distributions  for  the  DMs  of  Figure  7 


Table  3.  Configuration  Comparisons  for  Example  2 


77  =  1.0  [/»(//o)  =  0.5] 

nn-rwT* 

Operating  Point  of  the  Consulting  DM: 

(—£—  i 

'm  +  1  m  +  1 1 

(0. 1-  e) 

Operating  Point  of  the  Primary  DM  when  uc  =  0: 

(0, 1-  £) 

(0,  \~e) 

Operating  Point  of  the  Primary  DM  when  uc=  1 : 

(£»  1) 

(e,  1) 

Operating  Point  of  the  Team  : 

-g2  .  1  -C2_ 

W  +  1  ’  m  +  1  / 

(0.  \~£2) 

Probability  of  Error: 

g2-  « 
m  +  1 

2 

*  Optimal 


Now  suppose  that  the  better  DM  is  the  primary  DM.  The  optimal  operating  points  can  also  be 
found  on  Table  3  and  the  optimal  probability  of  error  is: 


(7) 
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Then  the  deterioration  of  the  team  performance  is: 


APe  =  Pi¬ 


pe  _  m-  1  £2 

Pl  -  ^TT  2 


>  0 


(8) 


and  the  relative  deterioration  of  the  team  performance  is: 

0}  =  AP±  =  '!LlL 

P\  2 


(9) 


Since  we  can  choose  any  m  >  1,  we  conclude  that  the  relative  deterioration  of  the  team 
performance  can  not  be  bounded  this  way.  But  also  note  that,  as  m -» <»,  the  absolute  magnitude  of 
the  deterioration  of  the  team  performance  goes  to  zero;  thus  as  the  relative  deterioration  increases, 
the  absolute  magnitude  of  the  deterioration  decreases. 


3.4.  Special  Probability  Distributions 

There  exist  certain  probability  distributions  for  which  the  configuration  with  the  better  DM  as 
the  primary  DM  seems  always  to  be  superior.  As  we  already  saw  in  section  3.1  this  is  not 
necessarily  true  for  discrete  distributions.  But,  our  numerical  analysis  suggests  that  it  is  true  for  the 
case  of  comparing  means  of  Gaussian  distributions  with  equal  variance.  Unfortunately,  due  to  the 
complexity  of  the  improper  integrals  involved,  no  theoretical  results  were  obtained  to  substantiate 
our  numerical  findings. 

On  the  other  hand,  in  the  case  of  exponential  distributions  with  different  rates  (or  equivalently 
of  comparing  variances  of  Gaussian  distributions  with  equal  means,  when  each  DM  receives  two 
observations)  not  only  it  is  always  better  to  designate  the  better  DM  as  the  primary  DM,  but  also 
we  were  able  to  obtain  a  proof.  Thus  consider  two  such  DMs;  from  [V68]  we  know  that  the  ROC 
curve  of  the  worse  DM  is  given  by: 

PE  =  (W  (10) 

and  the  ROC  curve  of  the  better  DM  is  given  by: 

pbD  =  ( pf r*k  (id 

where  the  exponential  rates  are  1/a  for  the  worse  DM  and  k/a  for  the  better  DM,  with  k  >  1  (for 
the  Gaussian  case  a  =  Oq IO\  with  G\  >  do). 

Suppose  that  the  better  DM  is  made  the  primary.  Then  from  (B.1)-(B.3)  and  the  property  of 
the  tangent  to  die  ROC  curve: 


(12) 


T7c 


Pl-P° 


P-T)  = 


dPl 


D 


dPp 


(PfPd) 


1  -/»/  dP,? 

no  =  7 —£r  V  =  -D- 


1  -PCD 


and: 


dPp 
dPrw 


(PfPd) 


=  O-dL 

*  Pp 

pO 

= 

pO 
‘F 


Pp 

"'-i"-  *>F 


{PfJPd) 


=  a^- 
Pf 


(13) 


(14) 


Solving  the  system  of  (12)-(14)  and  recalling  the  concavity  of  the  ROC  curve,  we  obtain  that: 

(/>,?,  P^)  =  (1,1) 


which  implies  that  whenever  uc  =  1  is  received  from  the  consulting  DM,  the  primary  DM  decides 
Up  =  1  independent  of  its  own  observation.  Substituting  into  (B.5)  and  (B.6),  we  obtain  that  the 
point  (Pp,  Pq)  of  the  team  ROC  curve,  in  this  case,  is  given  parametrically  by: 


and: 


pt,  =  pO  +  pc 

-  PpPp 

(15) 

II 

<5o 

+ 

<3S 

-  Pdpd 

(16) 

for  some  optimal  operating  points  (Pp,  Pq)  of  the  worse  DM  and  (Pp,  Pp)  of  the  better  DM. 

Now  suppose  that  the  better  DM  is  made  the  primary  DM.  Then,  we  can  arbitrarily  assign  to 
the  DMs  the  following  operating  points: 

(Pp,  Pq):  to  the  new  consulting  (worse)  DM 
(Pp,  Pq):  to  the  new  primary  (better)  DM  when  uc  =  0  is  received 
(1,1):  to  the  new  primary  (better)  DM  when  uc  =  1  is  received 


Substituting  into  (B.5)  and  (B.6)  we  obtain  (15)  and  (16)  again.  Since  for  this  arbitrary  assignment 
of  operating  points,  the  configuration  with  the  better  DM  as  the  primary  DM  can  achieve 
performance  equal  to  the  optimal  performance  of  the  other  configuration,  the  better  DM  should 
always  be  the  primary  DM. 


3.5.  Propagation  of  ROC  Curves 

Suppose  that  the  better  DM  is  made  the  consulting  DM  in  the  example  of  section  3.4  above. 
Then  from  the  system  of  (10)-(14),  we  can  solve  for  Pp  to  obtain: 
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Pi  = 


kof{  i  -Ph)n 


[o5(l-^)]  r-[of (!-/*/)»?]  r 


W(i  - ^o)]  [off  ( i  -/*/) n]  \ 


-8 


(17) 


where: 


/*  = 


A. 


of -(To 


of 

y  =  - 1 - 

of-oi 


s  = 


k  of 


kof-oi 


(18) 


(17)  is  an  equation  of  just  Pp.  We  could  have  substituted  for  Pf,  from  (15),  but  did  not  do  it 
because  of  space  limitations.  If  the  equation  is  solved  Pp  is  obtained.  Moreover: 


p  o 
‘F 


a 


i-/yc 
i  -Pf> 


v 


(19) 


By  substituting  into  (13),  Pq  is  obtained.  Finally  by  substituting  for  all  the  probabilities  into  (15) 
and  (16),  the  team  ROC  curve  is  obtained  as  a  function  of  77,  the  variances  and  k. 

It  should  be  clear  that  the  team  ROC  curve  will  not  be  of  the  same  form  as  the  ROC  curves  of 
the  individual  DMs.  In  fact,  it  can  not  be  given  in  a  closed  form  expression.  Thus,  the  results 
cannot  be  easily  extended  to  the  case  of  three  DMs  in  tandem  even  for  these  particular  probability 
distributions. 


4.  TWO  DMs  IN  PARALLEL 

The  team  which  consists  of  two  DMs  in  parallel  (Figure  1(b) )  was  the  First  one  to  be  studied 
in  this  framework  [TS81].  It  was  shown  that  even  if  the  DMs  are  identical  and  the  cost  structure 
symmetric,  the  optimal  decision  rules  of  the  two  DMs  do  not  have  to  be  symmetric.  This  was 
attributed  to  the  explicit  dependence  of  the  cost  function  on  the  decisions  of  the  DMs. 
Subsequently,  this  result  was  also  demonstrated  with  a  simple  example  for  the  case  where  the  cost 
function  depends  implicitly  on  the  decisions  of  the  DMs  through  the  fusion  center  [T88].  The 
necessary  conditions  which  characterize  the  optimal  decision  rules  of  the  two  DMs  are  presented  in 
appendix  D.  We  further  analyze  the  problem  in  order  to  understand  the  reasons  of  the 
counterintutive  behavior  of  the  team  members. 

4.1.  Second  Order  Optimality  Conditions 

As  was  mentioned  above  the  optimality  conditions  of  appendix  D  are  necessary  conditions. 
We  also  derive  the  second  order  necessary  conditions  for  optimality  in  order  to  enhance  our 
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understanding  of  and  intuition  about  the  team  behavior.  These  conditions  depend,  as  the  first  order 
conditions  do,  on  whether  the  AND  or  the  OR  decision  rule  is  the  optimal  rule  employed  by  the 
fusion  center. 

PROPOSITION  1.  Consider  the  team  which  consists  of  two  DMs  in  parallel  and  a  fusion 
center,  and  performs  binary  hypothesis  testing  ( Figure  1(b) ). 

(i) .  If  the  fusion  center  employs  the  AND  rule  as  its  optimal  decision  rule,  the  second  order 
necessary  optimality  conditions  are  given  by  the  following  inequalities: 

~1  +  la  lb  ^  0  (20a) 

or: 

OcCtbPoPD  >  (-  1  +  ria  Tfe)2  (20b) 

where  On  is  the  second  derivative  of  the  ROC  curve  at  the  operating  point  (Pp,  Pp),for  n  =  a,  b. 

(ii) .  If  the  fusion  center  employs  the  OR  rule  as  its  optimal  decision  rule,  the  second  order 
necessary  optimality  conditions  are  given  by  the  following  inequalities: 

1  ~  lalb  ^  0  (21a) 

or: 

OCaCCbi  1  -  P£)  0  -  />£)  >  (n  -  T]a  lb)2  (21b) 

Proof.  Only  (20)  needs  to  be  proved  because  (20)  and  (21)  are  symmetric.  To  prove  (20), 
consider  the  two  operating  points  (Pp ,  Pp)  and  (Pp,  Pp)  which  satisfy  the  first  order  conditions 
and  without  loss  of  generality  assume  that  Pp<Pp.  Perturb  Pp  to  Pp  +  e,  where  £  is  a  real 
number  of  very  small  magnitude;  then,  by  Taylor's  theorem,  the  perturbed  probability  of  detection 
will  be  Pp  +  e  ria  +  0.5£2Oa.  Similarly,  perturb  the  operating  point  of  the  other  DM  to 

(Pp  -  5,  Pp- Sib  +  0.5  8  2ab),  where  S  is  a  real  number  of  very  small  magnitude  with  eS  >  0; 
note  that  the  two  operating  points  should  be  perturbed  in  opposite  directions  so  that  they  continue 
to  satisfy  the  first  order  conditions. 

For  (Pp,  Pp)  and  (Pp,  Pp)  to  be  globally  optimal,  they  need  to  satisfy  the  following  necessary 
condition: 

+ <  JL. (/>;+£)</>*- S)  * 

+  — L_[l -(Pg  +  +  0.5£'2Oa)(/>D- <5  +  0.55  20t*)]  => 

0  <  £  (lPp-laPp)  +  S  (-  1  Pf  +  lb  Pp)  +  eS(-l+lalb)  + 
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+  e2(-  0.5c<b  P%)  +  S2(-  0.5 ab  P£)  +  H.O.T.  (22) 


For  global  optimality,  (22)  should  hold  for  both  positive  and  negative  perturbations  £  and  8 
which  implies  that  the  coefficients  of  £  and  of  8  should  be  zero;  these,  as  expected,  are  the  first 
order  conditions  of  (D.l)  and  (D.2)  respectively.  Moreover,  the  coefficients  of  f2  and  of  &  are 
non-negative,  because  the  ROC  curve  is  concave  and  thus  has  a  non-positive  second  derivative. 
Hence,  if  the  coefficient  of  e8  is  non-negative,  that  is  if  (20a)  holds,  then  (22)  holds  as  well. 

Assume  that  (20a)  does  not  hold;  (22)  may  hold  even  in  this  case  as  long  as: 

0(e,<5)  ■  e2(- 0.5  aa  P d)  +  e8 (- T] +  ria  rib) +  S2(- 0.5  Ob  Pd)  £  0  (23) 

for  £  and  8  sufficiently  small  with  e8  >  0. 


We  minimize  <p(£,  8)  with  respect  to  £  and  to  8.  Using  simple  calculus,  the  function  is  minimized 
with  respect  to  £  if  and  only  if: 


e  =  5  H  lb) 

<^Pd 


(24) 


Observe  that  the  coefficient  of  8 in  (24)  is  positive  (because  we  assumed  that  (20a)  does  not  hold), 
so  that  £5  >  0  as  required.  Substituting  for  £  from  (24)  into  (23),  we  obtain  that  (23)  is  true  if  and 
only  if  (20b)  is  true.  Q.E.D. 


CORROLARY  1.  Consider  again  the  team  of  the  previous  proposition.  Then,  the  second  order 
necessary :  conditions  for  optimality  can  be  written  in  the  following  equivalent  form: 

( i) .  If  the  fusion  center  employs  the  AND  decision  rule  as  its  optimal  decision  rule: 

-r\+llaT]b>  -{OaOtbPb  Pd)0  5  (25> 

(ii) .  If  the  fusion  center  employs  the  OR  decision  rule  as  its  optimal  decision  rule: 

V  -  r\a  Tib  *  -k  oth  0  -  P£)  (1  -  Pd)]°'5  (26) 


Proof.  Again  only  (25)  needs  to  be  shown,  since  the  proof  of  (26)  follows  by  symmetry.  We 
show  first  that  if  (20)  holds,  then  (25)  holds  as  well;  if  (20a)  is  true,  then  (25)  is  obviously  also 
true  because  the  right  hand  side  of  (25)  is  non-positive.  Suppose  that  (20a)  does  not  hold  and  that 
(20b)  holds;  then  by  taking  the  square  root  of  each  side  of  (20b),  we  obtain  (25). 
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To  complete  the  proof  we  have  to  demonstrate  that  if  (25)  is  true,  then  (20)  is  true  as  well;  so 
suppose  that  (25)  holds  and  distinguish  between  two  cases  depending  on  whether  -  r)  +  rjaTh,  £  0 
or  -  rj  +  rjar]b  <  0.  If  the  former  is  true,  then  (20a)  is  obviously  true;  if  the  latter  is  true,  take  the 
square  of  each  side  of  (25)  to  obtain  (20b).  Q.E.D. 


4.2.  Identical  DMs 

We  now  focus  on  the  special  case  where  both  DMs  are  identical.  Because  of  the  symmetry  of 
the  problem,  it  seems  intuitive  that  the  optimal  decision  rules  of  the  two  DMs  will  be  identical  or 
symmetric  at  least  for  the  case  where  T]  =  1  (i.e.,  perfect  symmetry  of  the  variables  external  to  the 
team).  It  is  known  that  the  optimal  decision  rules  neither  have  to  be  identical  nor  have  to  be 
symmetric  even  if  r)  =  1;  a  simple  example  with  discrete  probability  density  functions  was 
presented  in  [T88].  We  should  note  that  such  an  example  can  be  constructed  for  strictly  concave 
ROC  curves  as  well.  These  examples  indicate  that  it  is  optimal  in  general  for  the  team  to  split  the 
risk  unevenly  among  its  members  and  suggest  the  need  for  different  levels  of  command. 

From  an  organizational  designer's  point  of  view  it  is  desirable  to  assign  identical  decision 
rules  to  similar  DMs  having  the  same  position  in  the  organization;  this  not  only  significantly 
reduces  the  complexity  of  the  problem,  but  it  is  also  asymptotically  optimal  [T88].  So,  we  suppose 
that  both  DMs  are  restricted  to  employing  identical  decision  rules  and  derive  the  first  and  second 
order  optimality  conditions;  these  follow  directly  from  appendix  D  and  from  Corrolary  1  and  thus 
the  proofs  are  omitted. 


CORROLARY  2.  Consider  the  team  which  consists  of  two  identical  DMs  in  parallel  and  a 
fusion  center,  and  performs  binary  hypothesis  testing  {Figure  1  (b) ).  Suppose  the  two  DMs  are 
restricted  to  employing  identical  decision  rules.  Then  the  optimal  decision  operating  point  (Pp,  Pp) 
of  the  ROC  curve  satisfies  the  following  conditions: 

(i).  If  the  fusion  center  employs  the  AND  decision  rule  as  its  optimal  decision  rule: 


dPp 


dPf 


Pp 

=  ~V 


W.PS)  Pd 


(ii).  If  the  fusion  center  employs  the  OR  decision  rule  as  its  optimal  decision  rule: 


dPp 

dPp 


iPI,  Pd) 


1  -PP 
\-PP 


(27) 


(28) 
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REMARK:  Because  of  the  concavity  of  the  ROC  curve  there  exists  one  and  only  one  point  on 
every  ROC  curve  which  satisfies  each  of  (27)  and  of  (28). 

CORROLARY  3.  Consider  again  the  team  of  Corrolary  2.  Then,  the  second  order  necessary 
conditions  for  optimality  are: 

(i) .  If  the  fusion  center  employs  the  AND  decision  rule  as  its  optimal  decision  rule: 

-il  +  (Tin)2  >  anP£  (29) 

(ii) .  If  the  fusion  center  employs  the  AND  decision  rule  as  its  optimal  decision  rule: 

n-(7?„)2  >  and -PS)  (30) 

The  above  conditions  suggest  that  DMs  whose  associated  ROC  curves  have  steep  changes, 
implying  large  absolute  values  for  the  second  derivative,  are  likely  to  have  identical  optimal 
decision  rules  (for  example  ROC  curves  for  nearly  uniform  noise). 

4.3.  Performance  Bounds 

As  was  mentioned  above,  in  [T88]  it  was  shown  that  as  the  number  of  DMs  in  a  parallel  team, 
which  performs  binary  hypothesis  testing,  increase  to  infinity,  the  decision  rules  of  the  DMs  may 
be  restricted  to  be  identical  without  any  deterioration  in  the  team  performance.  Since  this  is  not  true 
for  the  parallel  team  which  consists  of  two  DMs,  we  would  like  to  determine  whether  bounds  exist 
for  the  deterioration  of  its  performance. 

(i).  Absolute  Bound 

Consider  two  identical  DMs  whose  optimal  decision  rules  are  not  identical  for  some  given  T ]*, 
as  the  ones  in  Figure  9(a);  suppose  also,  without  loss  of  generality,  that  the  optimal  decision  rule 
for  the  fusion  center  is  the  AND  decision  rule.  The  operating  points  of  the  DMs  have  to  satisfy  the 
necessary  optimality  conditions  of  (D.l)  and  (D.2);  without  loss  of  generality  assume  Pp  <Pp . 
Also  consider  two  new  identical  DMs  with  the  three-piecewise  linear  ROC  curve  of  Figure  9(b). 
The  new  DMs  are  of  course  worse  than  the  original  DMs;  still,  for  the  particular  77*,  the  new 
(worse)  team  can  achieve  performance  equal  to  the  optimal  performance  of  the  original  (better) 
team,  since  the  operating  points  {Pp ,  Pq)  and  ( Pp ,  Pq)  can  also  be  employed  by  the  new  (worse) 
DMs.  Therefore,  if  the  DMs  are  restricted  to  employing  identical  decision  rules,  an  upper  bound 
for  the  deterioration  in  the  performance  of  the  original  (better)  team,  for  the  particular  r\*,  is  given 
by  the  deterioration  in  the  performance  of  the  new  (worse)  team. 
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Table  4.  The  Probability  Distributions  for  the  DMs  of  Figure  9(b) 


Thus,  the  problem  is  reduced  to  obtaining  bounds  for  teams  which  consist  of  DMs  with  three- 
piecewise  linear  ROC  curves1.  Consider  again  the  DMs  of  Figure  9(b),  whose  underlying 
probability  density  functions  are  presenred  in  Table  4.  The  set  of  possibly  optimal  decision  rules 
may  be  found  by  exhaustive  enumeration.  Since  each  DM  has  to  perform  a  likelihood  ratio  test, 
there  are  only  two  candidate  decision  rules  for  each  DM  n ,  n  -  a,  b: 

[i]  =  1  if  and.  only  if  y„e  { 2) 

[ii]  un  =  1  if  and  only  if  yne  {1,  2) 

Thus,  we  need  to  consider  six  cases: 

[  1  ]  Both  DMs  employ  [i]  and  the  fusion  center  employs  AND 

[2]  Both  DMs  employ  [ii]  and  the  fusion  center  employs  AND 

[3]  DM  a  employs  [i],  DM  b  employs  [ii]  and  the  fusion  center  employs  AND 

[4]  Both  DMs  employ  [i]  and  the  fusion  center  employs  OR 

[5]  Both  DMs  employ  [ii]  and  the  fusion  center  employs  OR 

[6]  DM  a  employs  [i],  DM  b  employs  [ii]  and  the  fusion  center  employs  OR 


REMARK:  In  order  to  avoid  the  explicit  dependence  of  the  probability  of  error  on  both  costs  and 
prior  probabilities,  we  define  the  (normalized)  probability  of  error  in  terms  of  r\  as  follows: 


pe 


n 

rj+  1 


Pf  + 


I 

7?+  1 


(1  -Pd) 


(31) 


1  This  fact  was  formalized  and  generalized  in  [T89a]. 


For  the  given  rj*,  denote  by  Pf  the  team  probability  of  error  when  the  decision  rules  of  case 
[f]J  =  l, 6,  are  employed  and  by  AP  'the  minimum  deterioration  in  the  team  performance,  if 
both  DMs  are  restricted  to  employing  identical  decision  rules.  Since  [3]  was  assumed  to  be  the 
optimal  set  of  decision  rules: 

AP •  <  Pf  -  Pi  =  [-Pf  (Pf  -  Pf)]  +  [PB  C Pd  -  Pd)]  s  AP\  (32a) 


«  po  rt-Ppl  >  n* 

pfipf-pf) 


(32b) 


APe  <  Pi-  P\  =  [Pf  (Pf  -  Pf)]  -  ^77  ~  P =  ^2  (33a) 


<=>  rj*  > 


PpiPp-Pp) 

Pf(Pf-Pf) 


(33b) 


APe  <  P%-P\ 


=  [Pf  (1  -Pf)+  Pf  (1  -  Pf)] 


~  ^-T  I^D  0  -  /»£)  +  Pf  (1  -  Pg)]  =  AP%  (34a) 

?7  +  1 


Pf(\-Pf)+Pf(\-Pf) 


(34b) 


dP*  <  P5-P3 


=  a -pf)+pf  a  -Pf)1  - 


-  -^[PdO-P^  +  PdO-Pd)]  =  AP%  (35a) 


^  ^  >  P/?(1-Pd)+Pd(1-Pp) 
Pf(\-Pf)+Pf(\-Pf) 


(35b) 


0  <  PI-  Pf 


=  ^^[Pfil-Ph+PfU-Pf)]  -  ^j[pSO-Pd)  +  Pd^~Pd)] 


>  PS(\-PbD)+Pf>(\~PaD) 
Pf(l-Pf)  +  Pf(\-Pf) 
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REMARK:  (36)  does  not  provide  a  bound  on  the  deterioration  of  the  team  performance  incured  by 
the  restriction  that  both  DMs  employ  identical  decision  rules,  because,  according  to  [6],  the  DMs  of 
the  team  do  not  employ  identical  decision  rules.  Nevertheless,  it  provides  a  condition  for  rj*  so  that 
[3]  be  the  optimal  set  of  decision  rules  employed  by  the  team. 


Using  simple  algebra  and  since  P^Pp  >  PpjPp  (Figure  9(b)  ),  we  obtain  that,  as  long  as 
(34b)  holds  true,  (35b)  holds  true  as  well;  this  implies  that  the  bound  of  (34a)  is  tighter  than  the 
bound  of  (35a).  So,  we  need  only  to  examine  (32a),  (33a)  and  (34a)  in  order  to  obtain  the 
maximum  least  upper  bound  for  the  deterioration  of  the  team  performance. 

Furthermore,  note  that  the  bound  of  (32a)  is  decreasing  with  77*,  while  the  bounds  of  (33a) 
and  (34a)  are  both  increasing  with  rj*.  Therefore,  the  maximum  least  upper  bound  of  (32a)  and 
(33a)  occurs  when  the  bounds  are  e^ual.  Thus: 


P\  -  P\  =  P{  -  P\  «  7]* 


Pp+PpP D-PP 
Pp  +  PP  Pp-Pf 


(37) 


Similarly,  the  maximum  least  upper  bound  of  (32a)  and  (34a)  occurs  when  the  bounds  are 
equal.  Thus: 

Pf-Pi  =  Pl-P\  <=>  77*  =  fjlLzfD.  (38) 

Pp  l-Pp 


REMARK:  Using  simple  algebra,  we  verify  that  the  77*  of  both  (37)  and  (38)  satisfy  (36)  because: 

PbD+PapPhD-n  >  t  Pd±PILlPd\  > 

Pp  +  Pp  Pp  -  Pp  \pp  Pp  -  pp  ’  p£  +  p?  1-Pfl 

>  Pd  (Pd  -  Pd)  +  (Pd  +  Pd)  U- Pd)  =  Pp  (1  -  Pp)  +  Pp  d  -  Pp) 
P$  {Pp  -  Pp)  +  (P%  +  P§)  (1  -  Pp)  P f  (1  -  Pp)  +  Pp  (1  -  Pp) 

and: 

Pp  1  -Pp  >  ^jPpd-Pp)  t  Pkd-Pp)\  >  P8(\-Pd)  +  Pd0-Pd) 

PP  1  -PP  \p°  (1  -Pp)'  Pp  (l-PP)j  Pp  (1  -  Pp)  +  Pp  (1  -PP) 

Substituting  for  77*  from  (37)  into  (32a)  (or  into  (33a) ),  we  obtain  the  maximum  least  upper 
bound  of  (32a)  and  (33a).  Substituting  for  77*  from  (38)  into  (32a)  (or  into  (34a) ),  we  obtain  the 
maximum  least  upper  bound  of  (32a)  and  (34a).  The  globally  maximum  least  upper  bound  is 
obtained  when  both  the  above  bounds  are  equal,  that  is  when: 
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Pp  +  Pp  Pp-Pp  _  Pp  1  —  Pp 
Pp  +  Pc  Pc  -  Pv  pf  1~Pf 


(39a) 


«  (P&  =  +  Pon-PD 

D>  P§\-PfF’  1  ~Pq 


(39b) 


To  maximize  the  least  uppei  bound,  the  two  operating  points  of  the  DMs  have  to  satisfy  (39b); 
it  is  not  hard  to  see  (Appendix  E)  that  to  maximize  the  least  upper  bound  for  a  fixed  (Pp,  Pp), 
subject  to  (39b),  the  operating  point  (Pp,  Pp)  has  to  satisfy: 

(Pf,  Pp)  =  |  (Pf)2  +  ~  °'5,  l  j 


-J(l+^-P/)  ,1 


Moreover,  substituting  from  (38)  and  (40)  into  (32a),  we  obtain  that  the  maximum  least  upper 
bound  of  the  deterioration  in  the  team  performance  as  a  function  of  (Pp,  Pp)  is  given  by: 


APe  < 


PpX~^ 
°  1  -P? 


■  -  l  _  i£.  (1  +/»«  -P“) 

a  i  pa  pa  K  u  r' 

n  I  n  /  n 


Pf  1  -Pf 


In  order  to  obtain  the  largest  absolute  deviation  from  optimality,  we  have  to  maximize  the 
bound  of  (41)  with  respect  to  Pp  and  Pp,  subject  to: 

0S/’p,<^<l  (42) 


Figure  10.  The  Probability  Distributions  that  Maximize  the  Absolute  Bound 
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TABLE  5.  The  Probability  of  Error  of  Team  of  Identical  DMs  of  Figure  10 


Decision  Rules  of  DMs 

[i]  and  [i] 

[ii]  and  [ii] 

[i]  and  [ii] 

AP‘  =  0.039776 
*  Globally  Optimal 


Fusion  Center  Decision  Rule 
AND  OR 

0.226179f  0.226179t 

0.226179f  0.518340 

0.186403*  0.412035 

tj  =  1.581904  [P(ll0)  =  0.612689] 
t  Optimal  for  Identical  Decision  rules 


Using  calculus,  the  bound  is  maximized1  for  (P/?,Pq)  =  (0.165438,0.677735),  giving 
Pp  =  0.607583  and: 

APe  <  0.039776  (43) 

Note  that  this  is  a  tight  bound;  it  is  achieved  by  a  parallel  team  which  consists  of  two  DMs,  whose 
underlying  probability  distributions  are  presented  in  T'._.  .e  iri.  for  rj*  =  1.581904  obtained  from 
(37)  (Table  5).  Thus,  assuming  minimum  probability  of  error  cost  structure,  the  absolute  deviation 
is  not  maximized  for  equal  prior  probabilities,  but  for:  P(Hq)  =  0.612689. 


(ii).  Relative  Bound 

Consider  the  exact  same  team  used  in  the  analysis  of  the  absolute  bound,  the  same  given  7)* 
and  again  denote  by  P\  the  optimal  probability  of  error  of  the  two  DM  parallel  team.  Also,  denote 
by  Pf  the  probability  of  error  when  the  DMs  are  employing  some  other  decision  rules;  then  define 
the  relative  deterioration  of  the  team  performance  as: 


of  s 


Pi- Pi 


(44) 


Proceeding  with  analysis  similar  to  the  above,  in  order  to  obtain  the  least  upper  bound  on  the 
relative  deterioration,  only  the  following  three  relative  bounds,  derived  from  (33a),  (34a)  and  (35a) 
respectively,  need  to  be  considered: 


1  To  be  more  specific,  we  expressed  Pf  and  Pd  in  terms  of  the  slopes  M  =  Pf/Pf  and  m  =  (1  -  Pfi)l(  1  -  Pf).  and 
then  maximized  with  respect  to  M  and  m  subject  to:  M  >\  >m. 
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^  e  ^  =  _ ,  ,  . 

p5  i?*Pf  p/ +  [i  -/,opol 

<  0=2  ,  mV*  [iT(P^]  .  ,  .  ^ 

P3  TJ*P^  Pp  +  [  1  —  Pp  Pp\ 

Of  <  Szg  =  ^l-d-^-Kl-^)2  _ !  s  ae 

n  rfPFaP»  +  [\-PZPZ\ 


(45) 

(46) 

(47) 


To  maximize  the  least  upper  bound  of  (45)-(47),  (39)  and  (40)  have  to  hold  again  (Appendix 
E);  substituting  from  (39)  and  (40)  into  (45): 


coe  < 


1  +P&-Pf 


1  ~Pf+Pd 


&(\+Pg-P?) 


pa 

rD 


0.5 


-  1 


(48) 


In  order  to  obtain  the  largest  absolute  deviation  from  optimality,  we  have  to  maximize  the 
bound  of  (48)  with  respect  to  Pp  and  Pp,  subject  to  (42).  Using  calculus,  the  bound  is  maximized 
for  (Pp,  Pp)  -»  (0,  1)  giving: 

<  1  (49) 

The  bound  of  (49)  is  a  tight  bound,  since  it  can  be  achieved  by  a  team  which  consists  of  two 
DMs,  whose  underlying  probability  distributions  are  presented  in  Figure  1 1,  as  e->  0.  It  is 
achieved  for  77*  =  1.0  obtained  from  (38),  as  can  be  seen  in  Table  6.  Note  that  this  100%  bound  is 
obtained  as  the  team  probability  of  error  is  going  to  zero.  As  the  optimal  probability  of  error 
increases  the  relative  deterioration  in  the  team  perfromance  is  considerably  smaller,  in  fact,  the 
relative  deterioration  for  the  example  of  Table  5,  in  which  the  absolute  deterioration  in  performance 
is  maximized,  is  only  21.34%. 

These  results  suggest,  that  it  could  be  worthwhile  for  the  designer  of  the  team  to  incur  some 
additional  error  and  in  the  same  time  considerably  simplify  the  complexity  of  the  problem  by 
restricting  similar  DMs  to  employ  the  same  decision  rules. 
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Figure  11.  The  Probability  Distributions  that  Maximize  the  Relative  Bound 


TABLE  6.  i  he  Probability  of  Error  of  Team  of  Identical  DMs  of  Figure  1 1 


Decision  Rules  of  DMs 

[i]  and  [i] 

[ii]  and  [ii] 

[i]  and  [ii] 


Fusion  Center  Decision  Rule 
AND  OR 


et 

et 

0.5£+  0.705e2  * 


et 

l.4l£+  e1 
1.205c-  0.707  e2 


of  ~  1.0  77=  1.0  [P(H0)  =  0.5] 

*  Globally  Optimal  t  Optimal  for  Identical  Decision  rules 


5.  TEAMS  OF  THREE  DMs 

There  exist  four  different  acyclic  architectures  for  a  team  which  consists  of  three  DMs;  the  two 
consultant  or  V'-architecture  (Figure  12),  the  three  DM  tandem  architecture  (Figure  13),  the  three 
DM  parallel  architecture  (Figure  14)  and  the  asymmetrical  architecture  (Figure  15).  We  compare  the 
performance  of  the  different  architectures  to  determine  whether  a  dominant  architecture  exists. 

It  is  worthwhile  to  understand  the  changes  in  the  complexity  of  the  decision  rules  when  the 
number  of  team  members  increases  from  two  to  three.  Three  thesholds  describe  the  decision  rules 
of  both  the  two  DM  tandem  architecture  (one  for  the  consulting  DM  and  two  for  the  primary  DM) 
and  for  the  two  DM  parallel  architecture  (one  for  each  DM  and  one  for  the  fusion  center).  Six 
thresholds  describe  the  decision  rules  for  the  V'-architecture  (one  for  each  consulting  DM  and  four 
for  the  primary  DM),  Five  thresholds  describe  the  decision  rules  for  both  the  three  DM  tandem 


Figure  13.  The  Three  DM  Tandem  Architecture 


Figure  14.  The  Three  DM  Parallel  Architecture 
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y*  y> 


Figure  15.  The  Three  DM  Asymmetrical  Architecture 


architecture  (one  for  the  second  consulting  DM,  two  for  the  First  consulting  DM  and  two  for  the 
primary  DM)  and  the  three  DM  asymmetrical  architecture  (two  for  DM  B  and  one  for  DM  C,  DM  A 
and  the  fusion  center),  and  four  thresholds  describe  the  decision  rules  for  the  three  DM  parallel 
architecture  (one  for  each  DM  and  one  for  the  fusion  center).  It  should  be  clear  that  the  complexity 
of  the  decision  rules  depends  not  only  on  the  number  of  the  DMs  in  the  team,  but  also  on  the 
particular  architecture  of  the  team.  Therefore,  we  will  compare  the  performance  of  the  different 
architectures  for  the  teams  of  three  DMs,  keeping  in  mind  that  the  complexity  and  communication 
requirements  are  not  the  same  for  all  architectures.  We  should  also  note  that  the  equations  which 
define  the  optimal  decision  rules  for  the  members  of  the  three  DM  teams  are  of  the  same  form  as, 
though  more  complex  than,  the  equations  which  define  the  optimal  decision  rules  for  the  members 
of  the  two  DM  teams1. 

As  was  shown  in  Lemma  1,  the  two  DM  tandem  architecture  is  superior  to  the  two  DM 
parallel  architecture;  it  will  be  interesting  to  determine  whether  a  dominant  architecture  also  exists 
for  the  teams  which  consist  of  three  DMs.  It  is  not  hard  to  construct  proofs,  similar  to  the  proof  of 
Lemma  1 ,  to  show  that  the  parallel  and  asymmetrical  architectures  cannot  perform  better  than  the 
V'-architecture.  Therefore,  to  determine  the  dominant  three  DM  architecture,  if  such  exists,  we  have 
to  compare  the  ^-architecture  and  the  tandem  architecture. 

In  several  places  in  the  literature  it  is  conjectured  and  supported  with  numerical  results  that  the 
V-architecture  is  better  than  the  tandem  architecture  [E82],  [R87],  [RN87a].  But,  consider  these 
two  architectures  when  the  primary  DM  is  a  very  bad  DM,  that  is  when  the  primary  DM’s 
observation  is  extremely  unreliable;  the  V-architecture  for  all  practical  purposes  reduces  to  the  two 


1  The  solutions  for  the  optimal  decision  rules  of  three  DM  tandem  architecture  and  of  the  ^-architecture  have 
appeared  in  [E82],  [R87]  and  [RN87a]. 
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DM  parallel  architecture  (Figure  1(b) ),  while  the  three  DM  tandem  architecture  reduces  to  the  two 
DM  tandem  architecture  (Figure  1(a) ).  Then,  according  to  Lemma  1,  in  that  particular  case  the 
tandem  architecture  is  superior  to  the  V-architecture.  Thus,  the  comparison  of  the  three  DM  tandem 
and  the  V-architecture  depends  on  the  particular  DMs  involved 

Subsequently,  it  was  suggested  that  the  'best'  V-architecture  achieves  superior  performance  to 
the  'best'  tandem  architecture,  where  'best'  refers  to  the  optimal  configuration  of  the  DMs  in  a 
particular  architecture.  This  suggestion  can  not  be  tested  in  general  because,  as  was  shown  in 
section  3,  the  'best'  optimal  configuration  of  the  DMs  in  a  particular  architecture  depends  not  only 
on  the  DMs  of  the  team,  but  also  on  variables  external  to  the  team  (i.e.,  costs,  prior  probabilities). 
But  in  the  special  case  where  all  three  DMs  of  the  team  are  identical,  there  exists  (obviously)  only 
one  configuration  for  each  architecture. 

We  would  thus  like  to  compare  the  V-architecture  and  the  three  DM  tandem  architecture  for  the 
case  where  all  three  DMs  are  identical.  Then  the  problem  can  be  reduced  to  comparing  the 
performance  of  these  two  architectures  for  DMs  whose  ROC  curve  is  piecewise  linear  with  at  most 
six  line  segments  (since  the  tandem  architecture  has  at  most  five  distinct  thresholds).  Proceeding 
with  analysis  similar  to  section  3,  we  obtain  the  following  examples. 

If  the  identical  DMs  receive  binary  observations,  the  V-architecture  achieves  centralized 
performance,  while  the  tandem  team  does  not;  thus  in  this  case  the  V-architecture  is  superior  to  the 
tandem  architecture. 

But,  the  tandem  architecture  which  consists  of  three  identical  DMs,  whose  probability 
distributions  are  presented  in  Figure  16,  achieves  better  performance  to  the  V-architecture  for  rj  = 
2.2,  and  achieves  worse  performance  for  tj  =  1.0  (Table  6).  Thus,  a  dominant  architecture  for  a 
three  DM  team  may  not  exist  and  the  optimal  architecture  may  depend  on  tj,  even  if  all  the  DMs  are 
identical.  The  team  ROC  curves  for  both  the  V-architecture  and  the  tandem  architecture  can  be  seen 
in  Figure  17. 


P(y|H0> 


y- 


Figure  16.  DM  for  which  the  Optimal  Architecture  Depends  on  tj 
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Table  6.  Architecture  Comparisons  for  Teams  of  Figure  17 


(i).  77  =  2.2  [P(H o)  =  0.3125] 

Tandem 

Two  Consultant  (V) 

Operating  Point  of  DM  C2: 

(0.3,  0.7) 

(0.3,  0.7) 

Operating  Point(s)  of  DM  Cl: 

(0.0, 0.1)  if 
(0.3,  0.7)  if 

Me  2=0 

Mc  2=  1 

(0.3,  0.7) 

Operating  Points  of  DM  P: 

(0.0, 0.1)  if 

Me  1  =  0 

(0.0,  0.1)  if  mci  +  uc2  —  0 

(0.9,  1.0)  if 

Mcl=  1 

(0.0,  0.1)  if  «ci  +  mC2  =  1 
(0.9,  1.0)  if  uci+uC2  =  2 

Team  Operating  Point: 

(0.081,  0.568) 

(0.081,0.541) 

Probability  of  Error: 

0.1906875* 

0.199125 

(ii).  7]  =  1.0  [P(Hq)  =  0.5] 

Tandem 

Two  Consultant  (V) 

Operating  Point  of  DM  C2: 

(0.3,  0.7) 

(0.3,  0.7) 

Operating  Point(s)  of  DM  Cl: 

(0.0,  0.1)  if 
(0.9,  1.0)  if 

Me  2=0 
MC2=  1 

(0.3,  0.7) 

Operating  Points  of  DM  P: 

(0.0,  0.1)  if 

Mcl  =  0 

(0.0,  0.1)  if  uc\  +  uc2  —  0 

(0.9,  1.0)  if 

MC1=  1 

(0.3,  0.7)  if  uc i  +  uC2  =  1 
(0.9,  1.0)  if  uc\  +uc2  =  2 

Team  Operating  Point: 

(0.243,  0.757) 

(0.207,  0.793) 

Probability  of  Error: 

0.243 

0.207* 

Figure  18.  DM  resulting  in  Dominant  Tandem  Architecture 
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Figure  19.  Team  ROC  Curves  for  DMs  of  Figure  18: 


Tandem  is  the  Dominant  Architecture 


Furthermore,  the  tandem  architecture  which  consists  of  the  DMs,  whose  probability 
distributions  are  presented  in  Figure  18,  is  superior  to  the  V-architecture  for  all  values  of  the 
threshold  tj,  as  can  be  seen  from  the  team  ROC  curves  of  Figure  19.  Thus,  the  tandem  architecture 
may  be  superior  to  the  U-architecture. 

Therefore,  a  "globally"  dominant  architecture  for  the  teams  which  consist  of  three  DMs  does 
not  exist,  even  if  all  the  DMs  are  identical;  the  optimal  architecture  depends  on  the  DMs  involved 
and  on  parameters  external  to  the  team  (i.e.,  prior  probabilities  and  costs). 

6.  SUMMARY  AND  CONCLUSIONS 

The  architectures  of  some  very  simple  organizations  in  a  binary  hypothesis  testing  environment 
were  analyzed.  The  tandem  architecture  is  dominant  for  teams  consisting  of  two  DMs.  For  teams 
of  three  DMs,  a  dominant  architecture  does  not  exist  in  general.  The  optimal  architecture  of  an 
organization  depends  on  parameters  external  to  the  team,  like  the  prior  probabilities  and  the  cost 
structure.  Nevertheless,  there  exist  special  probability  distributions  for  which  the  optimal 
architecture  can  be  unequivocally  determined. 

The  problems  in  this  framework  should  be  approached  cautiously  because  counterintuitive 
results  are  common.  Still,  the  intuitive  solutions,  although  not  necessarily  optimal,  result  in 
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considerable  reduction  in  the  complexity  of  the  problem  and  in  relatively  good  performance.  Thus, 
it  may  be  advisable  to  sacrifice  optimality  in  favor  of  simple  but  reliable  suboptimal  solutions, 
which  is  in  accordance  with  the  famous  theory  of  satisfiability. 
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APPENDIX  A.  The  ROC  Curve  and  its  Properties 


Since  in  our  analysis  we  often  employ  the  ROC  curve  and  its  properties,  we  present  a 
summary  of  the  basic  concepts  relevant  to  our  research  from  [V68],  For  this  define  the  likelihood 
ratio  as: 


A(y) 


Pjy  Itfi) 

P{y\Ho) 


(A.l) 


The  likelihood  ratio  is  a  random  variable;  denote  the  density  of  A  when  H  is  true  by  P(A  I H) 
and  for  some  threshold  r\  define  the  probability  of  false  alarm  as: 


PFiri) 

and  the  probability  of  detection  as: 

Pd(V) 

The  ROC  curve  is  the  plot  of  Pq  versus  Pp  with  rj  as  the  varying  parameter.  It  is  usually 
defined  in  an  open-form  expression  by  the  two  parametric  equations  as  the  following  set: 

ROC  =  { (PF,  PD)  \  P F  =  Pf{ti),  PD  =  PD{ 77),  0  <  q  <  oo} 
or  equivalently  in  a  close-form  expression,  if  one  exists,  as: 

Pd  =  HPf) 

The  ROC  curve  is  a  concave  (except  for  some  special  esoteric  cases  [T89])  curve  which  goes 
through  (0,0)  and  (1,1).  One  very  important  property  of  the  ROC  curve,  which  we  explore  in  our 
analysis,  is  that  the  slope  of  the  tangent  to  an  ROC  curve  at  a  particular  point  is  equal  to  the  value 
of  the  threshold  ij  required  to  achieve  the  Pp  and  Pq  of  that  point. 


■I 


=  F{A\H0)dA 


=  [  fUiwi) 


clA 


(A.  2) 


(A. 3) 
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The  ROC  curve  is  a  convenient  tool  for  describing  DMs  and  it  is  also  a  convenient  tool  for 
ranking  DMs.  The  higher  the  ROC  curve  the  better  the  DM  since  a  higher  probability  of  detection 
corresponds  to  the  same  level  of  probability  of  false  alarm.  Thus,  we  can  give  the  following 
definition: 

DEFINITION  A.l.  Consider  two  DMs  a  and  b  with  associated  ROC  curves  fa  and  fb 
respectively.  We  say  that  DM  a  is  better  than  DM  b  if: 

f a(F  f)  ^  fb(Pp)  for  every  PF:0<PF<1 
and 

fa(PF)  >  fbiP f)  for  some  PF :  0  <  PF  <  1 . 

Note  that,  in  the  cases  where  the  ROC  curves  of  two  DMs  intersect,  the  DMs  cannot  be 
unequivocally  ranked;  which  DM  is  better  depends  on  factors  which  are  external  to  the  team, 
namely  the  threshold  r\.  We  remark  that  since  it  is  possible  to  construct  the  ROC  curves  for  human 
DM  based  on  empirical  data,  this  allows  us  to  rank  human  DMs  with  respect  to  the  specific 
decision  of  binary  hypothesis  testing.  Moreover,  if  a  DM  desires  to  minimize  the  probability  of 
error  it  must  operate  at  the  point  of  its  ROC  curve  which  corresponds  to  the  threshold: 

=  P(Hq)[J[\,  Hq)-J(0,  Hq)]  (A  4 

APPENDIX  B.  Optimal  Decision  Rules  for  Two  DMs  in  Tandem 

PROBLEM  B.  A  team  consisting  of  two  DMs  in  tandem  performs  binary  hypothesis  testing 
(Figure  1(a) ).  The  costs  J(uh  H)  which  are  incured  by  the  team  when  the  team  decision  is  u,  and 
H  is  the  true  hypothesis  as  well  as  the  prior  probabilities  ( P(Hi )  >  0  for  i  =  0,  1)  are  assumed  to  be 
known.  Each  DM  receives  a  conditional  independent  observation.  The  consulting  DM  makes  a 
decision  based  on  its  observation  and  transmits  a  binary  message  (uc  =  0  or  uc  =  1)  to  the  primary 
DM.  The  primary  has  the  responsibility  of  the  final  team  decision  (up=  0  or  up=  1)  which  will  be 
based  on  its  own  observation  and  the  communication  from  the  consulting  DM.  The  decision  rules 
for  the  two  DMs  which  minimize  the  expected  cost  are  to  be  determined. 

The  optimal  decision  rules  have  to  satisfy  the  following  necessary  conditions  [ET82J.  For  the 
primary  DM: 

up=  1  c 

If  uc  =  0:  A(yp)  ^  rj  =  Vo  (B.l) 

1  —  in 
Up  =  0  D 
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If  uc=  1  : 


A(yp) 


up=  1 


up  =  0 


PCF 

—  n 

pc  ' 
r n 


(B.2) 


For  the  consulting  DM: 


A(yc) 


uc=  1 

* 

Uc=  0 


pi  pO 
‘F  ~  ‘F 

pi  p  0 

“n~ /  n 


(B.3) 


where  7]  was  defined  in  (A. 4),  with  PlD  and  Pp  respectively  the  probability  of  detection  and 
probability  of  false  alarm  for  the  primary  DM  when  uc  =  i  was  send  by  the  consulting  DM  (z  =  0, 
1)  and,  Pq  and  Pp  respectively  the  probability  of  detection  and  probability  of  false  alarm  for  the 
consulting  DM. 

REMARK  1 .  It  should  be  clear  by  now  that  the  decision  thresholds  of  the  two  DMs  are  given  by  a 
set  of  coupled  equations.  For  example: 


V  Ho 


(B.4) 


REMARK  2.  The  two  messages  assigned  to  the  consulting  DM  do  not  have  to  be  denoted  0  and  1. 
For  that  maner  they  can  be  denoted  m\  and  m2.  Without  loss  of  generality  assume  that: 


P(uc  =  mi  |  Hp)  >  P(uc  =  m2  j  Ho) 
P{uc  =  m\\H\)  ~  P(Uc  =  m2\H\) 


(B.5) 


Then  it  can  be  shown  that  when  the  primary  DM  receives  uc  =  m\,  it  will  always  be  more  likely  to 
decide  up  =  0  and  when  he  receives  uc  =  m2,  it  will  always  be  more  likely  to  decide  up  =  1 .  Hence 
the  interpretation  of  mj  as  0  and  of  m2  as  1. 

REMARK  3.  The  ROC  curve  of  the  team  as  a  whole  can  be  computed  and  is  given  by  the 
following  two  parametric  equations: 

P'fO 7)  =  [l  ~PHV)]Pf(V)  +  Pf(V)Pf(V)  (B.6) 

PbW  =  [l -PdWAPdW  +  pd01)  PbOl)  (B.7) 

Note  that  the  team  ROC  curve  depends  not  only  upon  the  characteristics  ("expertise")  of  the 
individual  DMs,  but  also  on  the  particular  way  that  they  have  been  constrained  to  interact  (the  team 
or  organization  architecture). 
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APPENDIX  C.  The  Analysis  of  a  Two  DM  Tandem  Team 

The  discussion  below  may  seem  confusing,  but  in  fact  it  is  simple  ani  straightforward.  We 
compare  the  performance  of  four  teams  for  a  particular  value  of  the  decision  threshold;  Figure  C.l 
should  provide  a  brief  summary. 


? 

9 


? 

Figure  C.l.  Summary  of  the  Analysis 


Consider  two  DMs,  a  DM  B  better  than  a  DM  W  in  the  ROC  curve  sense  and  suppose  that  DM 
B  has  been  designated  as  the  consulting  DM.  The  solution  to  the  problem  for  some  77*  can  be 
described  by  the  three  operating  points  (Pp,  Pq)  and  ( Pp ,  Pq)  of  the  primary  DM  W  and  ( Pp ,  Pq) 
of  the  consulting  DM  B,  which  have  been  defined  in  appendix  B  above.  Consider  also  a  DM  VV 
whose  ROC  curve  consists  of  the  points  (0,0),  (Pp,  Pq),  (Pp,  Pq)  and  (1,1)  as  well  as  the  line 
segments  joining  them.  Finally  consider  a  DM  B'  whose  ROC  curve  consists  of  the  points  (0,0), 
(Pp,  Pq)  and  (1,1),  the  line  segments  joining  them  and  whose  ROC  curve  lies  above  the  ROC 
curve  of  DM  W.  There  are  six  different  cases  for  the  shape  of  the  ROC  curve  of  DM  B'  depending 
on  where  (Pp,  Pq)  lies  with  respect  to  (Pp,  Pq)  and  (Pp,  Pq)  as  can  be  seen  in  Figure  C.2. 


Figure  C.2.  The  Six  Cases  for  the  Consulting  DM 
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Consider  the  'restricted'  team  with  DM  W  as  the  primary  DM  and  DM  B'  as  the  consulting 
DM.  Note  that  the  performance  of  this  team  will  never  be  better  than  the  performance  of  the 
original  team  since  DM  W  is  worse  than  DM  W  and  DM  B'  is  worse  than  DM  B  by  construction; 
but  for  the  particular  Tj*  both  teams  achieve  the  same  performance  since  the  three  optimal  operating 
points  are  attainable  by  the  respective  DMs  of  both  teams. 

We  would  now  like  to  compare  the  performance  of  the  'restricted'  team  with  the  performance 
of  the  'reverse'  restricted  team  which  consists  of  DM  B'  as  the  primary  DM  and  DM  W  as  the 
consulting  DM.  Note  the  the  performance  of  the  'reverse'  team  is  obviously  never  better  than  the 
performance  of  the  team  which  consists  of  DM  B  as  the  primary  DM  and  DM  W  as  the  consulting 
DM. 

REMARK.  Henceforth,  for  the  sake  of  convenience,  we  will  refer  to  each  team  by  its  primary 
DM  since  it  is  clear  which  DM  is  its  "complementary"  consulting  DM. 

So  we  compare  the  'restricted'  team  with  DM  W  as  the  primary  DM  to  the  'reverse'  team  with 
DM  B'  as  the  primary  DM  for  all  six  cases  of  Figure  C.2.  If  the  'reverse'  team  performed  better 
than  the  restricted’  team  in  all  six  cases,  we  would  conclude  that  the  team  with  DM  B  as  its 
primary  DM  would  perform  better  than  the  team  with  DM  W  as  its  primary  DM;  hence  the 
conjecture  would  have  been  proven  true.  But,  there  exist  certain  cases  where  the  'restricted' 
performs  better  than  the  'reverse'  team;  hence,  Example  1  is  obtained. 


Pd 


Figure  C.3.  The  'Restricted'  DMs  of  the  Analysis 
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We  need  only  analyze  the  one  case  of  Figure  C.2,  which  is  presented  in  more  detail  in  Figure 
C.3.  This  is  done  to  demonstrate  the  method  for  the  analysis  of  such  problems.  From  Figure  C.3 
we  see  that  in  this  case  the  slopes  of  the  operating  points  have  to  satisfy  the  following  conditions: 


pO  pc  pi  pi  pO 

LR  >  LR.  >  LR.  >  ~  rR  > 


1  -P 


pO 

‘F 


Pf 


Pi -Pc 


1  -p? 


2-  > 


1  -P, 


1  -Pc 


V-  1> 


1  -Pi 


1  -Pi 


and: 


r±  >  PJ>  zfl  >  P/j-P#  >  Pfi-Pn  2  I z3. 

Pp  Pp  —  Pp  Pp  —  Pp  Pp  —  Pp  1  -Pp 


(C.l) 


(C.2) 


Moreover  recalling  that  the  operating  points  are  by  construction  optimal  for  the  ’restricted’  team  for 
r/*,  the  necessary  optimality'  conditions  for  the  primary  DM  can  be  written  as: 


and: 


p o 
' D_ 

p 0 

rF 


Pn-P 


1  -pp  rr 

(C.3) 

1-P8 

Pf-p" 

>  0  pc 

D>PRn 

.  >  i-Pp 

(C.4) 

,0  pO  ' 

F  *£> 

1-Pf1 

and  for  the  consulting  DM  as: 


pc  pO  pi  pO  pi  pc 

>  l£_~  -/L  n*  > 

n  ■  i 


>0 


Pd-P°d 


Pc  —  Pc 


Pp-Pp 

(C.3)-(C.5)  can  be  summarized  with  the  help  of  (C.l)  and  (C.2)  as 


mm 


2?  Pn-Pn  Pn-Ppj  > 
|  1  -Pf  P?'  Pf-P"  Pf-P°  I 


\pf  1-pp1  Pp-Pp  Pp-Pp  I 


(C.5) 


(C.6a) 


(C.6b) 


We  should  note  here  that  the  probabilities  of  false  alarm  and  detection  for  the  ’restricted’  team 
are  given  by: 


and: 


PlF  =  (l  -Pp)Pp  +  PpPp 
Pd  =  (1  ~Pcd)Pd  +  PdPd 


(C.l) 

(C.8) 
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We  now  consider  the  'reverse'  team.  The  two  possibly  optimal  operating  points  for  the  new 
consulting  DM  W  are  (Pp ,  Pq)  and  (Pp,  Pq). 

CASE  I.  Operating  Point  of  the 'Reversed' Consulting  DM:  (Pp,  Pq) 

That  is  assume  from  (C.3)  that: 


Then  from  (C.l): 


and  from  (C.2): 


^*Vc 

Pf 


Vo  = 


1-P$ 
1  -Pd 


Combining  (C.l),  (C.6)  and  (C.10)  we  obtain  that: 


Vo  * 


(C.9) 

(C.10) 


(C.l  1) 


(C.l  2) 


Thus  the  optimal  operating  point  for  the  new  primary  DM  B'  when  uc  =  0  is  received  is  either 
(Pp,  Pd)  or  (Pf,PcD). 

Similarly  combining  (C.6)  and  (C.l  1)  we  obtain  that: 

3 2  <C13) 

Thus  the  optimal  operating  point  for  the  new  primary  DM  B'  when  uc=  1  is  received  is  either 
(Pp,  Pq)  or  (1,1).  We  have  four  subcases  for  the  operating  points  of  the  primary  DM  B'  which 
we  examine  separately. 


SUBCASE  l.l .  Operating  Point  of  the  'Reversed'  Primary  DM  when  uc  =  0:  (Pp,  Pf) 
Operating  Point  of  the  'Reversed'  Primary  DM  when  uc=  1 :  (Pp ,  Pf) 
Then  the  optimality  conditions  can  be  written  as: 


PCD-P% 

Pf-Pf 


*  Vo  * 


Pp-Pp 
Pf  -  Pf 
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1  pc  -P® 


and: 


l_pO  pc_pO 

Pk-Pcn 


>  T}*  > 


*  ^  1-pS  Pn-Pp 


\  —Pc  Pk-PCC 


(C.14) 


D 

>1 


Pc -Pi 


Pn  Pn-P 


e-  >  m  2  ^ 


1  -Pi 


r D  rD  ~  rD  >  n*  >  UL 

n  1  _  »  a 


P%  1  -Pb 


p)>  P'P‘ 


PZ  1  —P  c 


Also  from  (C.3): 


Pd-pcd 


(C.15) 


(C.16) 


In  view  of  this  we  check  our  assumption  of  (C.9): 


p  0 
vD 

pO 


_  p  1  pO 

>  ■  F  ~rF  Tl*  >  ~^D 


Pc  ~  Pi 


Pd-Pd 


pi  pO 

Pp  ~P  F 


This  is  indeed  true  from  (C.2)  and  (C.6). 

In  this  subcase  the  probabilities  of  false  alarm  and  detection  for  the  'reversed'  team 

by: 

p;  =  (1  -pf°)p;  + 

and: 

Pd  =  Ii-Pd)Pd  +  PpPp 

Comparing  the  probabilities  of  false  alarm  for  the  'restricted'  and  the  'reversed'  teams: 

PlF  =  (l -Pf)Pp  +  PpPp  <  (l  -Pf)pf  +  PfPf  =  Pf 
For  the  'reversed'  architecture  to  be  better: 


1  V 

F 


(CM) 

are  given 
(C.18) 
(C.19) 

(C.20) 


Pd-Pd  =  Pd  ~Pp  1  ~Pb  >  *  >  1  ~ Pp 
Pc -Pc  Pc -Pc  l-Pk  1  -pF 


(C.21) 


The  left  inequality  of  (C.21)  does  not  hold,  as  it  is  in  contradiction  with  the  right  inequality  of 
(C.15).  Therefore,  the  'restricted'  team  results  in  superior  performance  in  this  subcase. 


SUBCASE  1.2.  Operating  Point  of  the  'Reversed'  Primary  DM  when  uc=  0:  (Pf,  Pf) 
Operating  Point  of  the  'Reversed'  Primary  DM  when  uc=  1 :  (1,1) 

Then  the  optimality  conditions  can  be  written  as  (C.16)  again  and: 
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Also  from  (C.3): 


1  -P 


1  -Pi 


D-  > 


2  Vi 


Pp  1 zlh.  ^ 


p$  1  -Pi 


>  71* 


Vc  = 


1  -Pp 

1  -PS 


(C.22) 

(C.23) 


In  view  of  this  we  check  our  assumption  of  (C.9): 


CB.  > 

p  o 
*F 


II 


i -pcd 


71*  Z 


Pp  ~  Pp 
Pf-Pf 


(C.24) 


This  is  indeed  true  from  (C.2)  and  (C.6). 

In  this  subcase  the  probabilities  of  false  alarm  and  detection  for  the  'reversed'  team  are  given 


bv: 


and: 


Pp  =  (l  -P$)P§  +  PF  1 
Pp  =  (l -Pp)Pp  +  Pp  1 


(C.25) 

(C.26) 


Comparing  the  probabilities  of  false  alarm  for  the  'restricted'  and  the  'reversed'  teams: 

n  =  (i  ~p§)p}  +  PiPi  s  +  p°  =  pf 

For  the  'reversed'  architecture  to  be  better: 

P/S-Pd  ,  pg.  izfi  >  2  1-Pp 

Pf'-Pf  Pf  1-Pf1  1-Pf 


(C.27) 


(C.28) 


The  left  inequality  of  (C.28)  does  not  hold,  as  it  is  in  contradiction  with  the  right  inequality  of 
(C.6b).  Therefore,  the  ’restricted’  team  results  in  superior  performance  in  this  subcase. 


SUBCASE  1.3.  Operating  Point  of  the  'Reversed'  Primary  DM  when  uc  =  0:  (Pp,  Pp) 

Operating  Point  of  the  'Reversed'  Primary  DM  when  uc=\:  (Pp,  Pp) 

We  can  immediately  state  that  the  ’restricted'  team  results  in  superior  performance  in  this  subcase. 
Otherwise  the  optimality  of  the  operating  points  (Pp,  Pp)  and  (Pp,  Pp)  of  DM  W  and  (Pp,  Pp)  of 
DM  B'  would  be  contradicted,  because  the  operating  points  (Pp,Pp)  and  (Pp,Pp)  can  be 
employed  by  DM  W  and  (Pp,  Pp)  can  be  employed  by  DM  S'. 
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SUBCASE  1.4.  Operating  Point  of  the  "Reversed’  Primary  DM  whenuc=0 :  (Pp,  Pp>) 
Operating  Point  of  the  'Reversed'  Primary  DM  when  uc=  1 :  (1,1) 

We  can  state  that  the  'restricted'  team  results  in  superior  performance  in  this  subcase  for  the  same 
reasons  as  in  Subcase  1.3  above. 

CASE  II.  Operating  Point  of  the  'Reversed'  Consulting  DM:  (Pp,  Pq) 

The  analysis  is  omitted  since  it  is  exactly  analogous  to  the  analysis  of  Case  I  above;  again  we 
conclude  that  the  'restricted'  team  results  in  superior  performance. 

Hence  we  can  construct  two  DMs  as  the  ones  in  Figure  C.3  knowing  that  the  tandem  team 
with  the  better  DM  as  the  consulting  DM  will  achieve  superior  performance. 


APPENDIX  D.  The  Optimal  Decision  Rules  for  the  Two  DM  Parallel  Team 


PROBLEM  D.  A  team  consisting  of  two  DMs,  DM  a  and  DM  b,  in  parallel  performs  binary- 
hypothesis  testing  {Figure  1(b)  ).  The  costs  J(ut,  H)  which  are  incured  by  the  team  when  the 
decision  of  the  team  is  u,  and  H  is  the  true  hypothesis  as  well  as  the  prior  probabilities  (P{H,)  for  i 
=  0,  1)  are  assumed  to  be  known.  Each  DM  receives  a  conditional  independent  observation,  makes 
a  decision  based  on  its  observation  and  transmits  a  binary  message  to  a  fusion  center.  The  fusion 
center  employs  a  maximum  a  posteriori  probability  (MAP)  decision  rule.  The  decision  rules  for  the 
two  DMs  which  minimize  the  expected  cost  are  to  be  determined. 


The  fusion  center  has  two  alternative  choises  for  its  decision  rule;  either  employ  the  AND 
decision  rule  (i.e.,  decide  ut  =  1  if  ua  =  1  and  w*  =  1)  or  employ  the  OR  decision  rule  (i.e.,  decide 
u,=  1  if  ua=  1  or  Ub=  1).  If  the  fusion  center  is  employing  the  AND  decision  rule,  the  optimal 
decision  rules  of  the  DMs  have  to  satisfy  the  following  necessary  conditions  [E84],  For  DM  a: 


and  for  DM  b: 


ua  =  1 

A(ya)  ^ 

Mfl  =  0 

Ub=  1 

Myb)  ^ 
ub-  0 


(D.l) 


(D.2) 


If  the  fusion  center  is  employing  the  OR  decision  rule,  the  optimal  decision  rules  of  the  DMs  have 
to  satisfy  the  following  necessary  conditions  [E84].  For  DM  a: 
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(D.3) 


and  for  DM  b : 


ua-  1  ,  _  p  b 

My a)  ^  1  =Ty 

ua  =  0  l~Po 


Mb  1  ,  _  p  a 

a<m  Z  -r-fin 

u*=o  x~Pd 


(D.4) 


and  T)  was  defined  in  (A. 4)  with  Pq  and  Pp  respectively  the  probability  of  detection  and  of  false 
alarm  of  DM  n ,  for  n  =  a,b. 

REMARK  1 .  The  decision  thresholds  of  the  two  DMs  are  given  by  a  set  of  coupled  equations.  For 
example,  if  the  AND  decision  rule  is  employed  by  the  fusion  center: 


Pd  -  pUtyb)  2  ^  17  Hi) 

rD  I 


(D.5) 


REMARK  2.  The  ROC  curve  of  the  team  as  a  whole  can  be  computed;  for  example,  if  the  AND 
decision  rule  is  employed  by  the  fusion  center,  the  ROC  curve  of  the  team  is  given  by  the 
following  two  parametric  equations: 

Pkn)  =  Pkmpkn)  (D.6) 


w  =  pm  pm 


pm  =  pm  pm 


(D.7) 


APPENDIX  E,  Obtaining  the  Bounds  for  the  Two  DM  Parallel  Team 


(i).  Absolute  Boumd 

Suppose  that  (Pp,Pp)  is  given;  then  the  problem  of  maximizing  the  least  upper  bound  of 
(32a)-(34a)  can  be  formulated  as  follows: 

PROBLEM  E.l.  max  AP  f  =  -j?—[-P?(Pp -Pp)]  +  —L—[p°(pj>-P*)]  (E.l) 

( Pt,PfoeA  ?7*+l 

where  A  is  the  set  that  is  defined  by  all  the  pairs  (Pf,  Pp)  satisfying  the  following  four  constraints: 


pO  1  DO  pO  /pO  pO\ 

PjL  1  ~ LD.  (pb) 2  +  PUZZLE! 


PP  1  -Pp 


1  -Pn 


LEL  <  EEL 


(E.3) 
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1  -Pd  ^  1  -Pd 

(E.4) 

1  -P,b  1  -Pf 

0&P?<P&Zi 

(E.5) 

3 

* 

II 

1 

(E.6) 

p§  1  -p§ 

(E.3)-(E.5)  are  constraints  dictated  by  the  concavity  of  the  ROC  curve.  We  solve  (E.2)  for 
Pp>  0  and  substitute  into  (E.  1);  we  then  take  the  derivative  of  AP{  with  respect  to  PF: 


dAP* 

dPp 


77*  +  1 


-P?  +  PdPf 


1  -pg 


-0.5 


(E.7) 


The  derivative  in  (E.7)  is  zero  only  if  Pp  =Pp,  which  results  in  a  minimum  (AP f  =  0). 
Differentiating  one  more  time  both  sides  of  (E.7),  we  obtain: 


d1AP\ 

d(Pp)2 


r\*  +  1 


Pd 


+  pm-pji 

F  \-P? 


■  1.5 


PpiPp-P?) 

\  —Pc 


>  0 


(E.8) 


Thus,  for  all  Pp,  such  that  Pp  >  Pp,  the  derivative  of  AP{  with  respect  to  Pp  is  positive  and 
increasing;  therefore,  it  is  maximized  with  respect  to  (Pp,  Pp)  at  the  boundary  point  given  by  (40). 


(ii).  Relative  Boiund 

Suppose  again  that  (Pp,  Pp)  is  given;  then  the  problem  of  maximizing  the  least  upper  bound  of 
(45)-(47)  can  be  formulated  as  follows: 

PROBLEM  E2.  max  <yf  =  V*  (PF)2  +  \  -  (Pp)2  _  j  (E.9) 

(Pf  ,  Pd)  e  A  Tf  PFa  Ppb  +  \  -  P%  P% 

where  A  is  the  same  feasible  set  as  in  Problem  E.l. 


Proceeding  in  a  similar  manner  as  in  (i)  above,  we  show  that  the  relative  bound  is  maximized 
with  respect  to  (Pp,  Pp)  again  at  the  boundary  point  given  by  (40).  To  see  this  note  that  the 
maximization  in  (E.9)  above  is  obviously  equivalent  to: 


49 


max  y(P%,  Pd) 
(Pf,  Pd)  e  A 


Tf  (Pf)2  +  I  -  (PaD)2 
Tfpppb+X-ptpb 


(E.10) 


The  function  t//  is  well  defined  and  non- zero  for  all  the  pairs  ( Pp ,  P^),  since  both  the 
numerator  and  the  denominator  are  always  strictly  positive.  Then,  the  maximization  of  (E.10)  is 
equivalent  to: 


min  £(Pp,  P$) 
(Pf,  Pd)  £  A 


rfflPl+^PpPp 

Tf{P£)2+\-(PaD)2 


(H.  11) 


This  in  turn  is  equivalent  to: 


max  -$(Pf,Pd) 
(Pf,  Pd)  e  A 


zltfiELzllfDfL 

Tf  (Pf)2  +  1  -  (P£)2 


(E.12) 


But  barring  constant  terms,  the  maximization  of  (E.12)  is  the  exact  same  maximixation  of 
(E.l).  Since  (E.l)  is  maximized  for  (Pp,  Pq)  given  by  (40),  both  (E.12)  and  consequently  (E.9) 
are  also  maximized  for  (Pp,  Pq)  given  by  (40). 


